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Abstract 

The notion of a successful coupling of Markov processes, based on the idea that both 
components of the coupled system "intersect" in finite time with probability one, is extended 
to cover situations when the coupling is unnecessarily Markovian and its components are only 
converging (in a certain sense) to each other with time. Under these assumptions the unique 
ergodicity of the original Markov process is proven. A price for this generalization is the 
weak convergence to the unique invariant measure instead of the strong one. Applying these 
ideas to infinite interacting particle systems we consider even more involved situations when 
the unique ergodicity can be proven only for a restriction of the original system to a certain 
class of initial distributions (e.g. translational invariant ones). Questions about the existence 
of invariant measures with a given particle density are discussed as well. 

1 Introduction 

Let (X, 23) be a measurable space equipped with a metric g(-, •) and assume that the resulting 
metric space is locally compact. A Markov chain f* acting on this phase space is defined by 
a family of transition probabilities P t (x,A) to jump from a point x £ X to a measurable set 
A G B during the time t > and an initial distribution of the random variable £ representing 
the initial state of the Markov chain. The Markov chain £* generates two semigroups of operators 
P t (j){x) := J 4>(y) P t (x , dy) acting on bounded measurable functions and P'/x(0) := /i(P*ttV) acting 
on measures. 

One of the first questions in the analysis of Markov chains is the existense/uniqueness of 
their invariant (stationary) measures (solutions to the equation P\\i = \x Vt) and convergence 
to them for various initial distributions. We shall describe a novel approach to study these 
questions applicable to a reasonably broad class of Markov chains. 

To a large extent various coupling results about Markov chains are based on the so called 
coupling inequality applied as follows: let £* and be two Markov chains with the same transition 
probabilities and initial conditions £° = x, £° = y defined on a common probability space 
(£l,J-,W Xt y) where the distribution f x ,y depends on x,y measurably. Denote by r° a random 
variable, called intersection time, equal to the first moment of time such that = Vt > 

t . In other words r° is the moment of intersection of realizations of two Markov processes 
started from the points x,y G X. Using this notation the coupling inequality can be written as 
follows: 

sup \F Xiy (e £ A) — F^ytf eA)\< P(r° > t). (1.1) 
AeB 
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Assuming now that there exists a probability invariant measure fi (called also a stationary 
distribution) of the Markov chain and that the process £* is started in the stationary distri- 
bution [a, we have that the probability that £ A is equal to li(A) for any set A £ B and 
t > 0. 

Thus if the intersection time is finite with probability one the inequality proves the 

convergence in total variation of the law of to \x (see Section [2J. We refer the reader for 
excellent reviews of various results based on the coupling inequality to ^2 El EE! ■ 

Recall that a coupling is an arrangement of a pair of processes on a common probability 
space to facilitate their direct comparison, namely the coupling of Markov chains £* and is a 
pairs process (£*,£*) defined on the direct product space X x X and satisfying the assumptions 

F Xjy ((Z t ,?)eAxX)=F x (t t eA), 
€Xx A) =P y (£*e A) 

for each £ > 0, A £ B. Extending this definition for arbitrary initial distributions fi, v instead 
of initial points x, y one gets the coupling in this case as well. 

One says that a coupling is successful if the components of the coupled processes coincide 
starting from the finite moment of the intersection time. Under certain assumptions on the 
Markov chain it is believed that the existence of the successful coupling is equivalent to the 
convergence of distributions P(£* £ •) and P(£* £ •) (see, e.g. 12 ). Of course, such equivalence 
cannot hold for arbitrary Markov chains. Let £ is described by a deterministic difference relation 
x — » x/2. This relation defines a one-dimensional Markov chain with the unique invariant 
measure fx - the delta-measure at the origin. Moreover, any probability measure converges 
weakly under the action of this Markov chain to /x. On the other hand, two realizations of 
this Markov chain started at nonzero points x, y will never intersect in finite time and thus no 
successful coupling is possible. 1 Nevertheless any two realizations are becoming arbitrary close 
to each other, which leads to a generalization of the notion of the successful coupling. 

Fix a certain coupling of the Markov chains £* and and for a given e > denote by r £ 
a random variable, called quasi intersection time, equal to the first moment of time such that 
£*) <e Vt >r £ . 

We shall say that the coupling is metrically quasi successful if 

F Xt y(T £ < do) = 1 Var, y £ X, e > 0; (1.2) 
and topologically quasi successful if 

P*,„(1a(£*) 7^ M£'*)) ^ Vx,|/Gl (1.3) 

and any open set A £ B. Here 1a( - ) stands for the indicator function of the set A £ B. 

These definitions represent quite natural generalizations of the usual successful coupling. To 
the best of our knowledge the only published result in this direction is the discussion of the so 
called shift-coupling with close enough intervals of time in ^3] , see also some particular results 
about Markovian couplings for TASEP in [H lllj. 

Both definitions of the quasi successful coupling look very similar, but neither of them implies 
another one. Indeed, in the above example of the coupling of two copies of the processes defined 
by the map x — > x/2 the coupling is clearly metrically quasi successful. To show that it is 
not topologically quasi successful set A := R \ {0},x = 0,y = 1. Then 1 A (£*) = while 
1 A (^) = 1 Vt > 0, which implies P Xty (l A {^) + U(£*)) = L 0n the other hand > [t is obvious 

1 One might argue that in this toy model all "states" of the phase space except for the origin are "unessential" 
and this is the main reason of such behavior. This is not the case and we shall return to this question in the 
analysis of infinite particle systems in Section |S] 



that the property cannot imply (|1.2I) since arbitrary large deviations occurring with small 
probabilities are allowed in ()1.3|) but not in (|1.2|) . 

The coupling we consider needs not to be Markovian, however in the latter case the arguments 
might be significantly simplified (see Section |IJ). Another important question also discussed in 
Section 0] is whether it suffices to have two coupled Markov chains become equal (close enough) 
at a single moment of time, or whether it is necessary to have them remain equal for all future 
times as it is assumed in the definition of the (quasi) intersection time. 

The situation is becoming even more involved when we control the convergence between the 
components of a coupled system only up to a semimetric rather than a metric. This is typical 
for Markov chains described infinite interacting particle systems (see Section |S] and pT[] for a 
general review). In such cases there is no hope to study all invariant measures but as we shall 
show, using the ideas developed in the analysis of quasi successful couplings, one can prove the 
uniqueness of an invariant measure for a system restricted to a reasonably large class of initial 
distributions (e.g. translational invariant ones). 

It is worth note that various models of continuous time infinite interacting particle systems 
are very thoroughly studied (see, e.g. and further references therein). Methods used in these 
references are very model specific and are based on rather different arguments (monotonicity, 
positivity, duality, etc.) instead of a direct application of a version of a successful coupling. 
Moreover, there are only a few mathematical results [3 El El HS1 HI 01 ffl 2 about discrete time 
infinite interacting particle systems. The main reason here is that in the continuous time case 
with probability one only one "interaction" between particles can happen at a given time, while 
in the discrete time setting an arbitrary (even infinite) number of "interactions" may happen 
simultaneously. 

One of the main purpose of the present paper is to fill this gap and to develop some direct tools 
to study the latter situation. Therefore we shall discuss mainly the discrete time case, explaining 
(where it is necessary) how to change the arguments to prove the corresponding continuous time 
versions of our arguments. The construction of couplings satisfying our assumptions for specific 
particle systems is not trivial and will be discussed in a separate paper. 

Throughout this paper we shall not discuss the existence of invariant measures for Markov 
processes under consideration except for a special case of invariant measures with a given particle 
density discussed in Section H3 In general to prove the existence one might need to assume that 
these processes satisfy the Feller property (i.e. corresponding Markov operators leave the space of 
bounded continuous functions invariant) or some its generalizations and the compactness of the 
phase psace. The situation is rather different if one wants to study the existence of an invariant 
measure supported by a non compact subset of the phase space as in the case considered in 
Section El 

We follow the convention: the upper index is always reserved for time, while the lower index 
is used for space variables. The only exception is the upper index of the shift map which 
means the spatial translation by the vector £ and, in fact, can be interpreted as a time variable 
having in mind that we apply \£\ times the translation by the length one in the direction I. 

2 Functional- analytic approach 

For a Markov chain on a metric space (X, g) denote by 

Ps(g* £ A) := P\x, A), EM?)) := P l <P(x) 

2 Compare this to a rather extensive list of publications related to the continuous time case in Note also 
that the last three references are dedicated to a pure deterministic setting. 



the corresponding probability and mathematical expectation for the trajectory started from the 
point x E X. Recall that a measure [i is invariant (stationary) for the Markov chain if 

MiEx(^))) = M0) 

for any continuous function <f> : X — > M, where //(</>) := J*^ ^ cfyx. 

We start with a well known folklore conditional result about the uniqueness of an invariant 
measure of a Markov process assuming that this measure does exist. 

Theorem 2.1 Assume that there exists a probability invariant measure \x for a Markov chain 
(* and let 

¥ X: y(T° < oo) = 1 Vx,yeX. (2.1) 

Then \x is the only probability invariant measure of this Markov chain and P\v converges in the 
total variation metric to fx as t — > oo for any probability measure v . 

Proof. Consider a coupled system (£*, £*) whose trajectories are assumed to coincide after their 
first intersection. Integrating the inequality with respect the measures ji and v we have 

\P*v(A) - n{A)\ < J J F Xty (T° > t) du(x) dii{y) 

which vanishes as t — > oo due to the assumption (j2.ll) . □ 

In a more general setting different realizations of a Markov chain may not intersect but only 
converge to each other in time. It turns out that the previous result can be generalized to this 
setting as well (at least partially). 

Theorem 2.2 Assume that there exists a probability invariant measure \i for a Markov chain 
and let 

^x, y {T £ < oo) = 1 Vx, y € X, e > 0. (2.2) 

Then /x is the only probability invariant measure of this Markov chain and P^v < Z^5 > ^ wea kly 
for any probability measure v. 

Proof. Recall that a function <j> : X — > R is called Lipschitz continuous if there exists a finite 
constant Lip(0) such that 

\4>{x) - 4>{y)\ <U V (<j>) Q {x,y) (2.3) 

for any x,y £ X. 

Define \(f)\i := \4>\oo + Lip(</>) and consider only functions cp with bounded | • l^-norm. We 
have: 

ie^cc*) - E y 0(e*)i = i^m') - Ex,^(e*)i < E^i^ce*) - 0(^)1 

< 2|0| oo F a; , y (-r e > t) + eLip((/>)P Xiy (r £ < t) ^ eLipfa). 

Now since the left hand side does not depend on e > we deduce that |E X ^>(£*) — Ey0(£*)| * = ^> 0. 
On the other hand, for any measure v 

- P>(0) = fa X ^(E^*) - Eyft?)). (2.4) 

Observe that on a locally compact space the Lipschitz continuous functions are dense in 
the set of all continuous functions being constant at infinity (by Stone- Weierstrass Theorem). 
So to distinguish between any two probability measures on such space it is enough to consider 



only integrals of Lipschitz continuous functions. Hence the invariant measure is unique and 
pt v *z^> n weakly. □ 

A close look at the proof shows that in the relation Q2.4|) one needs to control the integrands 
only up to the sets of zero measure. Therefore the uniformity of the assumption 1)2.2(1 on the 
choice of pairs of initial conditions (x, y) may be significantly relaxed: 

Corollary 2.1 Let be probability invariant measures for a Markov chain £* and let 

V X)V {t £ < oo) = 1 Ve > (2.5) 

for n x v almost all pairs of points x,y G X. Then \x = v. 

3 Probability techniques 

In this section we shall study the topological quasi successful couplings. 

Theorem 3.1 Let be a Markov chain with an invariant measure \i and let be another 
version of the same Markov chain. Assume that there exists a topologically quasi successful 
coupling for the Markov chains i.e. the relation hl.'J\) holds. Then /i is the only probability 

invariant measure of this Markov chain and P^v ^ weakly for any probability measure v. 

Proof. For an open set A G B and a pair of points x,y £ X we introduce the notation 

&{x,y,A):= \V x>y (t t eA)-F x j£ t eA)\. (3.1) 



Then 

and 

Hence, 



F x<y ^ G A) = F XtV (? G A, (* £A) + F x>y (? G A, £* i A) 
G A) = P Xty (e G A,? G A)+P Xty (e £ A,? G A). 

<S>\x, y, A) = P Xiy (e G A, iA) - P x , y (e i A, ? G A) 



<p^(u(a/u(e*))^o, 

by the assumption (jl.3f) . 
On the other hand, since 

P x , y (e £ A) =P x (e e A) = P\x,A) 

and 

P Xt y(£ t eA)=F y (£ t €A) = P t (y,A) 
from the relation we get 

-**(z, y, A) < P\x, A) - P\y, A) < **(x, y, A). 



Integrating the last inequality with respect to the probability invariant measure dfi(x) and using 
that 

[ P\x,A) dn{x)=Piii{A)=n{A) 



we get 



Thus 



- J &(x,y,A) dii{x)<ii(A)-P\y,A) < j &(x,y,A) dLi(x). 

\n{A)-P\y,A)\ < J &(x,y,A) d^x). 

Therefore P t (y,A) *z!5 > n(A). Any bounded continuous function <f> can be approximated uni- 
formly by a finite combination of indicator functions. Therefore we have 

which implies the weak convergence of P\v. □ 

A close look at the above proof shows that if the relation (|1.3|) holds for a given set A £ B 
and any x, y £ X one has 

for any probability measure v. Thus at least on the set A the limit measure coincides with [i. 

The following simple generalization of this result is useful for the analysis of interacting 
particle systems. Let S : X — > X be a measurable bijection such that P l (x,A) = P t (Sx,SA) 
for any x £ X, A £ B, t>0. 

Corollary 3.1 Assume that all conditions of Theorem \3. 1\ hold except that instead of the topo- 
logically quasi successful coupling condition one assumes that there exists a coupling such that 

Vx^O-Ai?) + l A(St)) ^ MA £ B, x,y £ X, (3.2) 
Then the claim of Theorem \S.1\ remains valid. 

The proof of this result follows exactly the same lines as above except that one uses S£ 
instead of and later Sy instead of y since 

FyiS? £ A) = Pyd* £ S^A) = P\y, ST 1 A) = P\Sy, A). 

Similarly to Corollary 12 . II the result of Theorem l3.1l can be generalized for the case when the 
relation ()1.3|) holds only for almost all pairs of initial points x,y £ X. 



4 Markovian couplings 

A coupling is called Markovian if the pairs process is a Markov chain on the direct 

product space X x X. Under this assumption the proofs of our results about the uniqueness of 
the invariant measure might be significantly simplified by means of the following idea borrowed 
from . Observe that if the coupling is Markovian and the Feller Markov chain admits 

two probabilistic invariant measures /x ^ v then the Markov pairs process admits an 

invariant measure having marginals equal to [x and v correspondingly. Assume now that any 
version of the quasi successful coupling takes place. Then under the coupling the processes 
and £* eventually behave the same, which contradicts to the assumption that \i^v. 

Let be a Markovian coupling of two copies of the Markov chain £*. Denote by A4* 

the distribution of the pair at time t > and by tt^M 1 and ir^M* the projections of the 



measure M to the components of the coupled system. Then from a measure-theoretic point of 
view both our quasi successful coupling assumptions mean the the projections tt^M. 1 and 7T*.M* 
are becoming close to each other in a certain sense. On the other hand, the convergence of the 
projections 7r*.M* and n*Ai t immediately implies that under the action of the original Markov 
operator P* any two probability measures converge to each other. 

The Markovian assumption is very natural and, in fact, is satisfied in all main coupling con- 
structions. Using the idea proposed in under this assumption one can improve significantly 
the result of Theorem 12.11 

Theorem 4.1 Let be a Markovian coupling of two copies of a Markov chain on the 

probability space (Q,¥ xy ) and letr be a random variable such that £ T = £ r and¥ Xty (r < oo) = 1. 
Then if there exists a probability invariant measure \x of the Markov chain then P\v converges 
in the total variation metric to fi as t — > oo for any probability measure v. 

Proof. Define a new process: 

l£* otherwise. 

In ^3] it has been shown that if the coupling is Markovian then the process £ is Markov with 
the same transition probabilities P*(-,-). Thus the coupling (£*,£*) is successful according to 
our definition and the result follows from Theorem 12.11 □ 

One is tempted to use a similar argument to simplify the assumptions about the quasi suc- 
cessful couplings. Unfortunately this does not work even in the deterministic setting. Consider 
a binary map Tx := 2x (modi) defined on the unit interval X := [0, 1]. Then the direct product 
of these maps is a coupled process with the Markovian coupling. Moreover, for Lebesgue almost 
any initial point x G X and any y £ X the trajectories £* := T l x and := T l y are becoming 
arbitrary close infinitely many times. On the other hand, the dynamical system (T,X) has 
infinitely many ergodic probability invariant measures, in particular, the Lebesgue measure and 
the delta-measure at zero, which contradicts to Corollary 12.11 

5 Applications to particle systems 

By discrete space infinite particle systems one means the translational invariant dynamics of 
infinite configurations of particles on an integer lattice. We refer the reader to for a general 
discussion of systems of this sort. 

To apply the coupling technique to discrete space particle dynamics one needs to construct a 
coupling between different realizations of the dynamics. In distinction to the finite dimensional 
systems there is no much hope to achieve the usual successful coupling since this would mean 
that an infinite number of pairs of particles in the components of the coupled system need to 
share the same positions simultaneously. It seems more probable to get a version of a quasi 
successful coupling but even this setting turns out to be restrictive. The only known way to 
overcome this difficulty is to use a kind of a consecutive coupling based on pairing. By a pairing 
of two particles belonging to two different configurations we shall mean that up to a certain 
moment of time, which we call the pairing time, these particles behave independently of each 
other and after that time the rules applied to these two particles in both processes are assumed 
to be the same if this does not contradict to the definition of the process. If the latter event 
happen the pair needs to be broken. 

The most known construction, which we shall call an equal pairing is based on a very simple 
idea that two particles belonging to different configurations are becoming paired when they are 



located simultaneously at the same lattice site. This construction has been successfully applied 
e.g. in for a continuous time totally asymmetric exclusion process (TASEP). However 
even for a discrete time version of the TASEP (not speaking about more general exclusion 
type processes) the equal coupling does not work well since in the discrete time setting several 
particles may move simultaneously (which cannot happen in the continuous time case). Another 
also consecutive coupling making use of a non equal pairing has been proposed to solve this 
problem for the discrete time TASEP by L. Gray jHj, see also our forthcoming paper for the 
analysis of more general consecutive coupling constructions. Roughly speaking instead of pairing 
of particles sharing the same positions L. Gray proposed to pair particles located close enough. 
The main difference to the equal pairing is that one proves that eventually with time only pairs 
of particles with the same distances between their members survive almost surely. 

Even in the case of the equal pairing one cannot apply directly our results about quasi 
successful couplings since their conditions are still too strong. Typically one has to deal with 
one of the following scenarios: 

1. the upper density of the set of discrepancies between particle configurations (possibly 
calculated up to a finite spatial shift) vanishes with time; 

2. for any finite segment / G TL d the probability that particle configurations do not coincide 
on this segment (possibly calculated after a finite spatial shift) vanishes with time. 

Without spatial shifts these scenarios can be considered as direct generalizations of the quasi 
successful coupling and the weak quasi successful coupling respectively. Much weaker versions 
with spatial shifts are necessary to take into account situations when non equal pairs of particles 
survive in a coupled system. Note that despite both scenarios look very similar none of them 
is a consequence of another one. Indeed the presence of a finite number of fixed discrepancies 
does not change their density while it changes completely the situation described by the second 
scenario. 

Specific models of particle systems and specific pairing for them leading to above conditions 
will be studied in a separate paper and here we restrict ourselves to ergodic consequences of 
these scenarios. 

5.1 Functional-analytic setting 

Let X := A^ d , d > 1 be a space of be-infinite sequences with elements from a finite alphabet A 
endowed with the standard metric g(-,-) based on cylinders, namely 

g(x,y) := 2~ K M, 

where x, y £ X, n(x,y) is defined as the largest positive integer n such that xe = yi for all t E Z d 
such that \l\ < n, and \£\ := maxj^j. 

It is straightforward to check that the metric space (X, g) is compact. Recall that two 
probability measures fi, v are equal if = v{<p) for any continuous function 4> : X —> M. 
and different otherwise. In this sense measures can be distinguished by means of continuous 
functions. 

To be consistent with the previous results we fix also the standard sigma-algebra of Borel sets 
B on X based on cylindric sets and denote by A4 the set of all translational invariant probability 
measures m on X. The triple (X, B, g) forms a compact measurable metric space on which we 
consider our Markov chains. 

Since Lipschitz continuous functions are dense in the set of all continuous functions it is 
enough to use only Lipschitz continuous test functions to distinguish between any two distinct 
measures. 



We introduce a semimetric g(x, y) equal to the upper density of the set of discrepancies 
between the configurations x, y £ X as follows: 



x ,. #{k£Z d : x k ^y k , \k\ < n} 
p(x, y) := limsup ; r-j 

and say that a function <f> : X — > R is ^-Lipschitz continuous if there exists a finite constant 
Lip(<^>) such that the inequality 

\4>{x) - 4>(y)\ < Up(<j>)Q(x,y) (5.1) 

holds almost everywhere (a.e.) with respect to any translationally invariant measure. 

Using this notation the first scenario mentioned above can be reduced to the question up to 
which extent measures can be distinguished by means of ^-Lipschitz test functions. 

Clearly there are measures which cannot be distinguished this way. Therefore we restrict 
this question to translational invariant measures. Moreover, we shall restrict ourselves to some 
subset X r of the set of configurations invariant with respect to dynamics and to spatial shifts 

(e.g. the set of configurations of a given particle density). Denote by a 1 ^ 1 the spatial shift of 

ct 



the configuration^* by the integer vector £ G Z d , i.e. (cr £ £*)j := £*, 



Theorem 5.1 Let there exist a coupling of two identical particle systems £* ,£* such that for any 
two initial configurations € X r we have 

£(eVeV^o (5.2) 

for some £ £ Z d , \£\ < L with probability one. Then the cardinality of the set of translational 
(both in space and time) invariant probability measures of the Markov chain £* supported by X r 
cannot exceed one. 

Proof. We start with the stronger version of the assumption (|5.2|) without the spatial shifts 
namely we assume that: 

m t^ t) t^o Q (53) 

with probability one. 

Let /Li, v be two different translational, both in space and time, invariant probability measures 
of the particle system. Then there exists a continuous function <p which can distinguish between 
them, i.e. fj,((f>) ^ v (([)). On the other hand, any continuous function can be approximated by 
indicators of finite cylinders. Thus there exists a finite cylinder (I) with the base I C Z d for 
which /i((/}) 7^ v ((/)). Recall that a cylinder with the base I is the set of configurations i£l 
with the given subset of coordinates Xi for i E I, i.e. (I) := {x £ X : X{ = <n, i G /}. 

Consider a sequence of functions 

\£\<n 

where 1a(~) is the indicator function of the set A € X. 

Observe that the function -0o := 1^ distinguishes between the measures //, v. Therefore due 
to the translation invariance of these measures each of the functions ip n (-) again can distinguish 
between the measures fx, v. Moreover, 

v ' \l\<n y ' £<n 



for any n G Z + and thus 

|yu(Vn) - v{$ n )\ = Ifi^o) - u(ip )\ = Kl</>) - > 0. 

The limit function vp(x) := lmin^oo ip n (x) exists a.e. (with respect to any translational invariant 
measure) by the Birkhoff Ergodic Theorem. Due to the estimates above the limit function again 
distinguishes between the measures n, v. 

Let us show that this limit function tp is ^-Lipschitz continuous. For x G X and n G Z+ 
denote 

J n {x) := {i£Z d : \£\ < n, a e {x) G (/)}. 

Then i> n {x) = (2n + l)- d \J n (x)\. A single site may contribute to the value |J n (x)| at most a 
certain finite constant C which depends only on the cylinder (/) but neither on n G Z + nor on 
the configuration x G X. 

For a pair of configurations x, y G X and n G Z + denote 

D n (x,y) := {k G Z d : x k / y k , \k\ < n}. 

Then 

\M*)-My)\ <C(2n + l)- d \D n+]I] (x,y)\. 

On the other hand, 

limsup(2n + \D n (x,y)\ = g n (x,y). 

n^oo 

Therefore passing to the limit as n — > oo we get that the limit function is ^-Lipschitz 
continuous with the constant Lip(^) := C. 

Applying now the argument used in the first part 3 of the proof of Theorem 12.21 we get the 
result. 

Using similar arguments one considers also the case when the components of the coupled 
process converge to each other in terms of the semimetric g only after a finite spatial shift. □ 



5.2 Probabilistic setting 

Assume now that there exist a coupling of two identical particle systems such that for any given 
finite subset / G 7L the restriction of the components of the coupled system to / coincide at 
moment t > with probability going to one with time, i.e. 

for any two initial configurations from a certain dynamically invariant subset X r C X. 

Similar to the deterministic setting we say that a set Y C X is dynamically invariant if ^° G Y 
implies that ^£7 a.s. for any t > 0. 

Thus the probability that the configurations £* , £ coincide on any finite cylinder goes to one 
with time. Hence the relation 1)3. lj) is satisfied for any cylinder set. Using now that linear 
combinations of indicator functions of the cylinder sets are dense in the space of bounded 
continuous functions on X we may apply the claim of Theorem 13.11 

In the case when the restriction of the configurations to a finite segment / coincide only 
after a finite spatial shift a e follows from the same argument if we consider only (spatially) 
translational invariant distributions and use Corollary 13. II with S := a e instead of Theorem 13. 11 

Therefore we get the following result. Denote by A4 r the set of translational invariant 
probability measures supported by X r . 

' 5 Since we deal here only with Lipschitz continuous functions we do not need to apply the last part of the proof 
of Theorem 12.21 which deals with the approximations of continuous functions by the Lipschitz continuous ones. 



Theorem 5.2 Let £ be a Markov chain with an invariant measure p, G A4 r and let £ be another 
version of the same Markov chain. Assume that there exists a coupling under which 

= ^ 1 

for any pair of configurations £° = x, £° = y G X r , any finite segment I C and some 
I G \l\ < L < oo. Then P\v converges weakly to p as t — > oo /or any 1/ G A4 r . 

Corollary 5.1 Under all the assumption of the previous Theorem except for p G .M r the se- 
quence P\v converges weakly to some invariant measure which does not depend on v. 

6 Invariant measures with a given particle density 

As we already mentioned normally the proof of the existence of invariant measures can be 
reduced to the checking of some very general topological and metrical assumptions. The situation 
changes drustically if one wants to study invariant measures having some additional properties, 
e.g. supported by some dynamically invariant subsets. The problem here is that even if the 
phase space of the system is compact the dynamically invariant subset may not satisfy this 
property. 

To be more specific consider a class of locally interacting particle systems on the lattice Z d 
represented by Markov chains with the phase space X := A z , A := {0, 1, . . . , |„4| — 1}, |.A| < oo. 
For a configuration x G X and a lattice site i G Z d we associate the value Xi G A to the number 
of particles located at i. The dynamics is defined as follows. At each site of the lattice there is 
an alarm-clock and at time t > we consider only those lattice sites at which the alarm rings. 
For each particle located at such site i G Z d we calculate its velocity Vi, such that \vi\ < V < oo, 
using a (random or deterministic) procedure which does not depend neither on time nor on 
the configuration x. Here V plays the role of the largest allowed velocity and its boundedness 
defines the locality of interactions. Then one checks a certain admissibility condition related 
to the possibility to move a particle from the site i to the site i + v\. We assume that the 
admissibility condition is again local and depends only on the present positions of the particles 
in the 2y-lattice neighborhood of the site i. Only if this condition is satisfied the particle is 
moved to a new position. Then for all sites to where the particles were moved we restart the 
alarm-clocks (again using a certain random or deterministic procedure). 

Depending on the way how one restarts the alarm-clocks both continuous and discrete time 
particle systems can be considered. In what follows we restrict ourselves to a (more interesting 
from our point of view and much less studied) discrete time case, assuming that the alarm-clocks 
start with the same setting and after each restart we add one to the time. Therefore all particles 
are trying to move simultaneously. 

There is an important property that holds for all systems we consider here: particle number 
conservation. For a configuration x G X := A 1, and a finite subset I C 7L d denote by p(x, I) the 
number of particles from the configuration x located in / divided by the total number of sites in 
/, which we denote by |/|. Clearly < p(x,I) < \A\ — 1. Choosing a sequence of lattice cubes 
In := £ : \£\ < n} we consider the limit lim^^oo p(x, I n ). If this limit exists we call it the 
particle density of the configuration i£l and denote by p(x). 

According to the above informal description the particle systems under consideration are 
Markov chains on X. We assume the they satisfy the Feller condition, which together with 
the compactness of the phase space implies immediately the existence of an invariant measure. 
Moreover, due to the particle number conservation it seems that for each r G [0, \A\ — 1] there 
should be an invariant measure p r having a support on the set of configurations of density r. 



The following simple deterministic example shows that this is absolutely not the case. For 
d = 1 define a map T : X — > X as follows: 



In words, we preserve the central site, shift all other sites to the left and to the right, and set 
the sites ±1 to zero. 

Clearly all above assumptions are satisfied in this example and the particle density is con- 
served. On the other hand, for any initial configuration x G X the sequence of configurations 
T l x converges in the standard metric to the configuration of all zeros, having, of course, zero 
particle density. Thus this system has only one invariant measure supported by the configuration 
of all zeros. 

One might think that the result above is a consequence of the absence of the conservation of 
vacancies. Let us describe a simple probabilistic generalization of this example conserving both 
particles and vacancies and having exactly two invariant measures supported by the configuration 
of all zeros or all ones. Choose p £ (0, 1). For each particle in a configuration x G X located 
at a nonnegative site and having a vacancy immediately to the right we exchange the positions 
of these particle/ vacancy with the probability p. If the particle is located at a negative site we 
do the same but for the vacancy immediately to the left of it. This rule defines a discrete time 
Markov chain having the desired property. 

In what follows we discuss a coupling argument 4 which gives sufficient conditions for the 
existence of invariant measures supported by configurations of a given density. 

Let £* be a Markov chain on X := A 1, with translational invariant transition probabilities, 
i.e. P{x, A) = P{a^x, a 1 A) for any x € X, A € £>, I S Z d , which describes the dynamics of a 
locally interacting particle system. We shall say that a particle density p(p) of a translational 
invariant probability measure p is the mathematical expectation (with respect to this measure) 
of the number of particles located at the origin, i.e. p(p) := p(xo). 

The following simple result explains the reason why we use the same notation for the the 
particle densities of configurations and measures. 

Lemma 6.1 For each r € [0, |„4| — 1] there exists a translational both in space and time invariant 
measure p r such that p(p r ) = r. 

Proof. Choose any translational invariant measure p and consider a sequence of measures 



Due to the compactness of X there exists a subsequence n& — > oo such that p nk converges weakly 
to a limit measure v. Now using the Feller property we see that the measure v is invariant. The 
translation invariance of v follows from the construction and since the particle density of each 
measure p n is the same as for the initial measure p, we get p{v) = p{p). Consider a distribution 
7r := {vrj}j e ^4 such that Yli^i = r - To finish the proof it remains to notice that the Bernoulli 

4 The idea of this construction has been proposed by L. Gray for the case of the one-dimensional totally 
asymmetric exclusion process. It is worth note that the situation we consider differs significantly from the one 
studied by L. Gray in that particles may have velocities greater than one and thus long range interactions should 
be taken into account. 
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measure with the alphabet A and the distribution of symbols ir has the particle density which 
is exactly equal to r. □ 



Corollary 6.2 For each r G [0, \A\ — 1] the measure p r with properties described above can be 
constructed as a limit point of the sequence of ergodic averages of the measures Plp r ,B where 
p r) B is a Bernoulli measure with the particle density r. 

Unfortunately a translational invariant measure with the particle density r is not necessarily 
supported by configurations of density r. 

We shall say that a measure p is spatially ergodic if the dynamical system (a, X, p) is ergodic. 
We refer the reader to ^U] for general definitions related to ergodic theory of dynamical systems. 

Clearly each spatially ergodic measure is translational invariant and by the Birkhoff theorem 
it is supported by the configurations of the same particle density. 

Lemma 6.3 Let the initial distribution p of the process be spatially ergodic. Then almost 
surely for any t > the density for the configuration is well defined, does not depend on 
t, and is equal to the particle density p{p) of the initial distribution. 

Proof. For t = the existence of the limit in the definition of the particle density for the 
configuration £° and its coinscidence with p(p) follows from the Birkhoff ergodic theorem due 
to the spatial ergodicity of the initial distribution p. 

Choose n G Z + large enough and consider the lattice cube I n . We can estimate the difference 
between the number of particles located in I n at moments t and t + 1 as follows. Only particles 
belonging to the set I n \ I n -v are able to leave the the cube I n during one time step. Similarly 
only particles located at the set I n+ y\I n are able to enter the cube I n during this time. Therefore 
using that < p{^,I) < \A\ - 1 we get 

\p(e +l jn)- P (e,in)\ 

< |J "| J "- y| p(e,i n \i n - v ) + iwy-i p ^, In+v \i n) 

\!n\ l-'nl 

/ (2n + l) d - (2n + 1 - 2V) d (2n + 1 + 2V) d - (2n + l) d 



< 2\A\ max 



(2n + l) d ' (2n + l) d 



2V \ d ( 2V W 



2\A\ max | 1 - ( 1 - ) , ( 1 + —1— ) - 1 ™ 0. 



2n + 1 ) V 2n + 1 
This proves both the existence and the conservation of the particle density for the configurations 



Lemma 6.4 Let there exist a coupling of two copies £ , £ of our Markov chain such that for 
all initial configurations with the same particle density the conditions of either Theorem I5.il or 
Theorem 15.131 hold. Then for each spatially ergodic initial distribution p all limit points of the 
sequence of measures {-PJV}nez + coincide and the limit measure has the same particle density. 

Proof. Fix a spatially ergodic distribution p on X. Due to the compactness of X there exists a 

sequence of integers nj, oo such that the sequence of measures P* k p converges to a certain 
limit point, call it p. Passing to the limit as — > oo and using that p(P* k p) does not depend 
on nk G Z + we get that the limit distribution p also has the same particle density. The spatial 
ergodicity of p implies the spatial ergodicity of P™p for each n G Z + . 



Coupling 5 the process with the initial distribution /x and the one with we see that 

according to our assumptions these two processes eventually behave the same. Using the same 

arguments as in the proofs of Theorems 12.21 and 13.11 we get P™ k+1 fi n - — *° jl. Thus using the 
semigroup property P™ +1 = P™P* we have: 

fi = lim P" fc +V = P*( lim P^fi) = P*ji, 

k^oo \ k— >oo J 

which proves the invariance of the measure jl, and in turn implies that all limit points of the 
sequence of measures P^fi coincide and do not depend on fi. □ 

Finally let us discuss briefly a prototype coupling between two copies £ , £ of the Markov 
chain we consider here. To each particle we attach an additional parameter s 6 {0, 1} called 
state and if a particle is paired we set its state to 1 and to otherwise. We introduce also a 
parameter L > which will be used in pairing. 

At t = all particles in the configurations £° and £° are at state (unpaired). At time 
t > first we enumerate all particles in the configurations £ , £ with respect to their distance to 
the origin. If several particles have the same distance we enumerate them at random (similarly 
later when choosing the closest particles we shall take the one with the smallest index if there 
are more than one of them). Then we start the procedure with the particle r/ from the first 
configuration having the smallest index. 

If the particle rj is at state 1 (i.e. paired) we check its distance I to another member of the 
pair rj, and if £ > L we change the states of both these particles to (i.e. they become unpaired). 
Otherwise we check the distance £' to the closest particle rj" with state from another process. 
If £' < £ we swap the pairing setting the state of the particle rj to and the state of the particle 
rj" to 1 pairing it with r\. 

If the particle rj is at state (may be after the application of the previous step of the 
procedure) we check the distance t to the closest particle in the second process rj and if I > L 
we stop the consideration of the particle r]. Otherwise if the state of rj is we pair these particles 
setting their types to 1. If the state of rj is 1 we compare £ to the distance to another member 
of the paired particle rj and proceed exactly as in the case above. 

Then we continue the procedure with the next particle from the process £* until all the 
particles will be taken into consideration. Since only a finite number of particles may belong to 
the L-neighborhood of a given particle the procedure is well defined. 

During the time when two particles are paired all choices of their velocities in the coupled pro- 
cess are assumed to be identical. Therefore the particles from the same pair move synchronously 
until either the admissibility condition breaks down for only one of the particles (which basically 
means that its movement is blocked by another particle) or an unpaired particle comes close 
enough to one of the members of the pair (see Fig. QJ. 

This construction clearly defines a Markovian coupling between two copies of the Markov 
chain £*. Of course, without details of the procedures defining velocities and their admissibility 
one cannot check the validity of the conditions of Theorems 15.11 and 15.21 Sufficient conditions 
for this will be a subject of a forthcoming paper. 
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Figure 1: Pairing of particles. Black circles corresponds to the particles from the first component 
of the process and open circles with primed numbers to the second component. The paired 
particles are connected by stright lines. At time t the particles 1 and 1' are paired, while at time 
t + l the particle 1 becomes unpaired while the particle 1' becomes paired with the particle 2. 
The unpaired initially particles 3 and 2' become paired at time t + l. The velocities at time t 
are shown by vectors. 
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